Designing a Safe Autonomous Artificial Intelligence Agent based on Human Self-Regulation
نویسنده
چکیده
There is a growing focus on how to design safe artificial intelligent (AI) agents. As systems become more complex, poorly specified goals or control mechanisms may cause AI agents to engage in unwanted and harmful outcomes. Thus it is necessary to design AI agents that follow initial programming intentions as the program grows in complexity. How to specify these initial intentions has also been an obstacle to designing safe AI agents. Finally, there is a need for the AI agent to have redundant safety mechanisms to ensure that any programming errors do not cascade into major problems. Humans are autonomous intelligent agents that have avoided these problems and the present manuscript argues that by understanding human self-regulation and goal setting, we may be better able to design safe AI agents. Some general principles of human self-regulation are outlined and specific guidance for AI design is given.
منابع مشابه
STRATUM: A Methodology for Designing Heuristic Agent Negotiation Strategies
Automated negotiation is a powerful (and sometimes essential) means for allocating resources among self-interested autonomous software agents. A key problem in building negotiating agents is the design of the negotiation strategy, which is used by an agent to decide its negotiation behaviour. In complex domains, there is no single, obvious optimal strategy. This has le4d to much work on designi...
متن کاملAutonomy: Life and Being
This paper uses robot experience to explore key concepts of autonomy, life and being. Unfortunately, there are no widely accepted definitions of autonomy, life or being. Using a new cognitive agent architecture we argue that autonomy is a key ingredient for both life and being, and set about exploring autonomy as a concept and a capability. Some schools of thought regard autonomy as the key cha...
متن کاملGoal Conflict in Designing an Autonomous Artificial System
Research on human self-regulation has shown that people hold many goals simultaneously and have complex self-regulation mechanisms to deal with this goal conflict. Artificial autonomous systems may also need to find ways to cope with conflicting goals. Indeed, the intricate interplay among different goals may be critical to the design as well as long-term safety and stability of artificial auto...
متن کاملGeneral Aspects of Constructing an Autonomous Adaptive Agent
There are a great deal of approaches in artificial intelligence, some of them also coming from biology and neirophysiology. In this paper we are making a review, discussing many of them, and arranging our discussion around the autonomous agent research. We highlight three aspect in our classification: type of abstraction applied for representing agent knowledge, the implementation of hypothesis...
متن کاملA Causal Framework for Intelligent Agents and Multiagent Systems
Automation of organizational processes that make intensive use of expert knowledge has on the intelligent agent paradigm an appropriate metaphor. The idea would be introducing autonomous agents carrying out tasks on behalf of human users in organizational processes. Knowledge transference from experts to autonomous agents has been treated on different ways taking advantage of more than 20 years...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1701.01487 شماره
صفحات -
تاریخ انتشار 2017